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FIELD OF INVENTION 

The present invention relates to a computer-implemented system and method to process 
one or more time-series signals into representative piece-wise discrete trends. Applications 
include processing prices from financial data such as stocks, options, futures, commodities, 
currencies, indices, foreign government and municipal securities, bonds, treasury bills, foreign 
exchange rates, and interest rates; identifying features on a digital electrocardiogram (EKG) 
output such as anomalous trend lengths, amplitudes, shapes, or coefficients indicative of a 
problem with the patient; and identifying features from digital signals measured from machinery 
to investigate and identify problems with the machinery. 

SUMMARY OF PRIOR ART 

The prior art includes computational procedures for filtering noisy data. Kostelich and 
Yorke considered the motion of points around a phase space attractor. (Kostelich, Eric. J. and 
James A. Yorke, 1990, "Noise reduction: finding the simplest dynamical system consistent with 
the data", Physica D v. 41, pp. 183-196. ) They described a method called time delay embedding 
method to filter noise in chaotic experimental data whose dynamics are low dimensional. In 
their method, they created a series of vectors of m-dimensional points that are separated by a 
constant time delay (I.e. if m = 3, x, = (s n s i+T ,s i+2 J). A linear approximation of the vectors 
i x i ' x i + s » x i + 2s > A ) separated by a distance S would make it possible to calculate a linear 
approximation to the dynamics in the neighborhood of x t . Abarbanel suggested that instead of 
using strictly linear mappings in the neighborhood of x t , the process could be generalized to 
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include polynomial mappings. (Abarbanel, Henry D. I., Reggie Brown, John J. Sidorowich and Lev 
Sh. Tsimring, 1993, "The analysis of observed chaotic data in physical systems", Rev. Mod. Phys. , v. 65, 
no. 4, Oct. 1993, pp. 1331-1993.) 

U.S. Patent No. 5,537,368 issued July 16, 1996 to O'Brien Jr. et al., considered 
5 the problem of detecting signals from an underwater target. They derived a signal processing 
system consisting of a series of Kalman filters in parallel to process an incoming signal. Each of 
the Kalman filters fit a polynomial trend of order i (z = 0, 1, 2, . . .) to a data stream. The 
In coefficients of the polynomial, the data stream, and fit values representing the degree of fit of the 
M polynomial to the data stream were exported to a target motion system to determine the velocity 
10 and position of a target. 

^ U.S. Patent No. 5,956,702 issued Septemebr 21, 1999 to Matsuoka and Golea, noted the 

I s ;! problems with using a Kalman filter to process discontinuous changes in the time series trend, 
1= \ and taught a neural network to estimate a discontinuously changing time series trend, 
u Wolberg discussed using non-linear kernel regression to estimate prices at in the future. 
1 5 (Wolberg, John R., Expert Trading Systems: Modeling Financial Markets with Kernel 

Regression , John Wiley & Sons, Inc., New York, 2000.) 

The regressions are performed over a window that can either move or stay fixed as new 

points are added. He introduced the concept of a "growing option", where the values of new 

points are included in the regression for predicting the next point. After each point is predicted, 
20 it is then included in the prediction of the next point. Wolberg did not discuss discontinuities in 

the regressions, but did point out that regression models that are created in one period of time 

may not be useful in the future. 
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SUMMARY OF THE INVENTION 

An embodiment of this invention relates to processing discrete financial time series 
signals such as stock prices, options prices, futures prices, commodities prices, currency 
exchange rates, economic and financial indices, foreign government and municipal security 
5 prices, bond prices, treasury bill prices, foreign exchange rates, and interest rates. The invention 
is not restricted to financial applications. In this application, the term "time series" refers to both 
; ^ its literal definition of a string of values, representative of some process continuing through time, 
? v= each separated by a constant time interval, dt; and a vector of numbers separated by a constant 
y f interval or a pair of vectors where one of the vectors contains the location of the data elements in 
139 the second vector. In this application, the elements of a time series may be single data points or 
;^ sets of data points. The vectors data elements don't necessarily have to be equally spaced. For 
;f; example, a pair of vectors could include the land elevations and locations of those elevations 
\*\ along a trajectory that extends from Dallas to San Francisco. 

Over a period of time, these types of time series exhibit fluctuations, which can be 
15 characterized by a plurality of discrete "trends", where each trend represents a sequence of data 
elements when the data is generally increasing or decreasing at a certain linear or non-linear rate. 
Typically the data is "noisy" in that the data points may each deviate from the values defined by 
the trend. Typically, these trends do not last indefinitely, and it is of great interest to financial 
managers and others to determine when a trend has ended. 
20 The current invention addresses the analysis of time series data in a manner that provides 

useful information about the trends for a particular data set and how accurately those trends track 
the actual data. The method is based on the observation that while many different sets of discrete 
trends can be computed for a particular data set, a few of those trend sets are much better at 
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tracking subsequent data than others. In general, the method produces a relatively large number 
of discrete trend sets for a particular data set; evaluates the relative effectiveness of how well 
each set tracks the time series over which it was tested, and selects a few of those trend sets that 
are most effective in that tracking. The method then employs those more effective trend sets to 

5 evaluate subsequent data. 

In one embodiment a particular set or vector of time series data may be input to a 

n processor for analysis. 

□I In an alternative embodiment, the processor may access and analyze multiple sets of time 

yl series data to determine one or more sets which meet a selection criteria. Typically this selection 

iti criteria is related to relatively strong "trending" over a period of time, and the detection can often 
be made by a simple first-order, linear regression fit to the data. In that case, frequently the time 

ii] series datasets that have regressions with larger slopes and higher correlations with the time 

□ series garner more interest. 

The selected time series is fed into the processor to derive the optimum parameters for 

15 processing the time series. A subset of the time series is used as a "training" set. Inherent in 
deriving the parameters is the actual processing of the time series into discrete trends. One goal 
is to find the parameters that minimize the error between the time series and trend values, while 
maximizing the average length of the trends. Another goal is to find the trends that generate the 
greatest return from the beginning to the end of the trend. The two goals are not necessarily the 

20 same. 

Once the parameters have been selected, they are applied to the time series. In this step, 
an initial window size ( m l ) data values are selected from the beginning of the time series. In the 
preferred embodiment, a polynomial curve, representing the trend, is fit through these data 
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values. Each subsequent data value in the series is then added, and the trend is recalculated. A 
trend is determined to have ended when either: a) the last data value added to the trend exceeds a 
standard deviations limit, L s , of normalized deviations from the trend in the direction opposite to 

that of the trend; or b) the trend direction or derivative changes from positive to negative or vice 
5 versa. The last data value that was not part of the last trend becomes the first data value in the 

new trend. In trends after the first trend, the last m x data values from the previous trend are used 
4f in addition to the n points from the new trend to fit the trend curve. 

: \ i 

^ Once the trends have been identified, the trends, the original time series, and other results 

I j j are exported for further optional processing and to calculate values such as the average length of 
VQ the trends, the beginning and ending times and/or dates, the beginning and ending data values, 
□ and the average of the first derivatives of the trends. 

: j{ In applying this tool to multiple financial time series, such as stock prices and interest 

rate indices, it is apparent that the optimum trend determination parameters and the resulting 
trends differ from stock to stock. Some stocks are strongly trending, while others display other 

15 recognizable characteristics. Some stocks seem to display no apparent patterns after processing 
with this tool with the options available at this time. This tool has the ability to extract patterns 
from some seemingly random time series. While the patterns aren't deterministic, there seems to 
be a character or "personality" in regards to the length and shape of the patterns for many of the 
stocks processed so far. The trends resulting from different sets of trend determination 

20 parameters for a given model illustrate different aspects of that "personality". 

Specific trends either move up or down or are flat. These different trends identify 
different "states" of the process. It is reasonable to assume that within a trend that some 
mathematical methods of prediction or trading might be realized, and that a method of prediction 
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or trading would not necessarily work once the trend had ended. Certain trading systems might 

work within a flat trend might not work for a trend moving up or down. 

While individual models, each based on a single set of trend determination parameters, 

may do moderately well in defining when trends begin and end, better models may be achieved 
5 by combining the trends from different models to produce a composite model. For example, 

frequently after a single trend has ended, several very short trends will follow. Some of the trend 

algorithms described in this application do not do perform well while prices are oscillating 
[t: within a lateral range. They will produce numerous short trends in these models, which would 
\ ^ not be wise to trade. Therefore, several models could be combined so that once a trend ended; 
W the next trend that would be selected would be one that had the most data elements lasted the 

longest up to that point. 

f f The methods described in this application only take into account the previous values of a 

; Jf time series or vector to evaluate a new data element to determine whether it is within a trend or 

not. These methods can be improved to include other information that might affect the prices of 
1 5 a security, including other financial information. A method of doing this is an extension of the 

regressions described in this application and is multiple regression with additional independent 

variables. 

One of the outputs of this process is a set of normalized deviations from the dynamic 
trend. This time series oscillates between positive and negative values and could be used with 
20 thresholds as a trading indicator. 

If this method is able to extract a deterministic component of price movement from 
securities that can be modeled and simulated, then this has ramifications in regards to not only 



being able to make predictions about the future value of security prices, or to define different 
"states" in which to trade, but also to how options are priced. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The above-mentioned and other objects and features of the present invention will become 
apparent from a reading of the following detailed description with reference to the accompanying 
drawings, in which: 

FIG. 1 is a flowchart of the major analysis steps. 

FIG. 2 is a detailed flowchart of the time series data set selection steps. 

FIG. 3 is a detailed flowchart of the procedure for deriving the trend determination parameters. 

FIG. 4A is a detailed flowchart of the procedure for processing a time series to derive the trends. 

FIG. 4B is a diagram of the time series and the window length parameters that are used to filter 

the time series for the first and subsequent trends. 
FIG. 5 is a chart describing the post-processing of the time series trends. 
FIG. 6 is a representative plot of the product of the root mean square (RMS) error and the 

deviation limit, L s , versus the average trend length for a time series data set with 

multiple trend determination parameters. 
FIG. 7 is an example of a trend set fit to the closing stock prices for DELL Computer 

Corporation. The data that were used to select the trend parameters was from January 1, 

1994 to January 1, 1999. The selected trend parameters were then applied to the data 

from January 1, 1994 through January 23, 2001. 
FIG. 8 is a detailed flowchart of the of the procedure for deriving the trend determination parameters for 

the embodiment - "Alternatives to the Deviation Window Size ( m 2 )" 
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FIG. 9 is a detailed flowchart of the procedure for processing a time series to derive the trends for 

the "Correlation Coefficient Measure" embodiment. 
FIG. 10 is a detailed flowchart of the of the procedure for deriving the trend determination parameters 

for the embodiment - "Statistical Process Control Alternative" 
5 FIG. 1 1 is a detailed subset of the flowchart of the procedure for processing a time series to derive 

the trends for the embodiment - "Statistical Process Control Alternative" 

- I DETAILED DESCRIPTION OF EMBODIMENT 
130 Selecting a Time Series Data Set 

; 1 J In this embodiment, a plurality of time series data sets is analyzed in order to identify one 

: il or more data sets for further analysis. Referring now to Fig. 1 , which is a flowchart of the major 
□ analysis steps, in step 100 each of the data sets is analyzed to determine if the set is strongly 
il| trending. For each set, the last M\ data elements are extracted from the time series, and a line is 
Q fit through the points using multiple regression. In this example, M\ is selected to be about 30 
data points, or approximately 1.5 months of data. The normalized slopes and correlation 
coefficients are recorded. Upon such analysis of each of the data sets, a data set is selected for 
further analysis. When identifying financial instruments to trade, a time series that has a large 
increase or decrease in normalized slope with a correspondingly large absolute value of the 
20 correlation coefficient would be a likely candidate for subsequent processing. Time series data 
sets that have a small slope would generally be avoided. 

Referring now to Fig. 2, which is a more detailed flowchart of the data set selection steps, 
the initial search is performed through the following steps for each time series data set i: 



• In step 110, each time series data set, y tJ 9 j = \ 9 N [9 where N, is the number of elements in 
time series, is loaded into the processor. Note that a mathematical transform of a time series 
is also a time series (i.e. y"j = ln{y tJ \j = l^N i is also considered to be a time series). 

• In step 120, an initial window size M\ , is read by the processor, and the last M\ data points 
5 from the time series, y tJ = y iiN .- Ml +j ,j = hM l9 are selected. 

• In step 130, the series of the last M\ data points is normalized by dividing each data point by 

> so that the first data value is 1 .0. The normalized time series is designated as y f , where 

\1 y\ x = 1.0 . The normalization is performed in order to permit sorting of the data sets on a 

l i{ consistent basis, such as the slope of a line fit through the last M\ data points. Alternate 

ffl methods of normalization may be used such as: a) dividing the time series its mean or 
i"i median; b) ranking the values in the time series and using the ranks instead of the time series 
ill values themselves in the regression; or c) calculate the Fourier transform of the time series, 
M zero the zero-th frequency contribution, and back-transform the series back to the time 
domain. 

15 • In step 140, a line, y' Uj = a\x l%j + b\ , is fit through the Mi data points ( x i } , y\ } ) j = l 9 M 19 
x i j = j using linear regression. The slope of the line , a\ , is stored on the processor so that 
it may be used as a time series data set selection criterion. Alternate methods of data fitting 
may be used such as higher order polynomial regression or nonlinear regression. In this 
embodiment, the average of the first derivatives would be stored on the processor as a\ . 

20 • In step 150, if there are remaining time series data sets, steps 110-140 are repeated. 
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After each data set has been analyzed in steps 110-140, the results are reviewed in step 160. 
In this embodiment, the time series data sets are sorted according to the normalized slopes; a 
time series data set is selected for further processing and loaded in the processor in step 170. 

Alternate methods of data set selection may be used such as analyzing both the trend and 
positive or negative fundamental information. For example, a stock that has both an increasing 
trend, and a low price to earnings ratio may be a more desirable candidate than an overpriced 
stock whose trend is just as strong. Similarly overpriced stocks may become good candidates for 
selling short once they start trending down. 

Generating the trend determination parameters 

Referring again to FIG. 1 , once a time series data set has been selected and loaded in the 
processor, the trend determination parameters are selected at step 200. Inherent in this step is a 
processing of a portion of the time series to derive the parameters. The Initial Window Size (m x ) 
is the size of the first window that is the minimum number of data points needed to define a 
trend. The Deviation Limit ( L s ) is the number of deviations away from the trend that the next 

day's closing price or additional data value must be to signal a new trend. The deviations are 
defined as a measure of the spread of a distribution. Common statistical measures of spread of a 
distribution are variance, standard deviation, inter-quartile range, and range between the 
minimum and maximum values. In this invention, L s refers to any and all measures of spread of 

a sample of values. 

Each set of trend determination parameters in combination with the particular data fitting 
procedure, such as polynomial regression, produces a unique set of trends for a time series data 
set. At this step of the method, many different sets of trend determination parameters preferably 
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are used to produce corresponding sets of trends. These multiple sets of trends are then 
evaluated to determine which of the sets are better at matching the current data from the time 
series data set. 

The trend determination parameters can be selected in several ways. In this embodiment, 
5 a subset of the time series, the first M 2 data points of the time series (where N i is the number of 
data points in the entire time series data set under evaluation) are selected for defining the trend 
determination parameters. However, the time series is not limited to this embodiment, and trend 
: vj determination parameters can be derived from any time series or one or more simulations of time 
iji series. In this embodiment, the parameter selection is manual so as to allow the selection of more 
1X3 than one set of parameters to generate multiple optimum trends with different trend lengths for a 
given time series as will be discussed in Fig. 6, 

Referring now to Fig. 3, which is a detailed flowchart of the procedure for deriving the 
]*\ trend determination parameters. A set of trend determination parameters is generated in step 200 

by looping in increments between minimum and maximum values for each of the trend 
15 determination parameters. In this embodiment, two trend determination parameters are used- the 
Initial Window Size (m x ) which is evaluated between a starting value M1MIN and an ending 
value Ml MAX in an increment Ml INC; and Deviation Limit ( L s ) which is evaluated between a 

starting value LSMIN and an ending value LSMAX in an increment LSINC. Typical values for 
these variables are: 

20 M1MIN = 3 

M1MAX = 70 

M1INC = 1 

LSMIN = 1 

LSMAX = 20 
25 LSINC - 0.5 
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The trend determination minimum, maximum, and increment parameters are determined 
through experience. If either of the selected trend determination parameter values is equal to 
Ml MAX or LSMAX for a selected trend set, then this would indicate the need to increase the 
LSMAX or Ml MAX values. The M1INC and LSINC are selected with a tradeoff between 
accuracy and time. Ml INC cannot be smaller than 1. The smaller the values for the increments, 
M1INC and LSINC, the longer it takes to process all of the trends. However, with smaller 
increments, there is an increased likelihood of obtaining trend parameters that produce more 
accurate trends. The lower bound Initial Window Size, M1MIN, is limited by the order of the 
polynomial that one is using for the trend. For a linear trend (a line) one needs at least two 
points to fit a line. For second-order polynomials, one needs three points to fit a curve to the 
data points. 

In step 200, these values are generated in a nested loop resulting in approximately 2,500 
sets of trend parameters. Referring again to Fig. 1, it is usually desirable to process these sets in 
step 400 as the values are generated. For each parameter set, the following values are calculated 
and exported: 

• the number of trends in the subset of the time series ( N Tfends );; 

• the RMS Error between the input data values and trend values; 

• the average length of the trends; 

• the average trend length / m x , where m x is the minimum number of data points needed to 
define a trend; 

• the average return (%) of the trends; 

• the cumulative return (%) of the trends; 
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• the fraction of correct predictions, where the initial trend was increasing and the ending price 
was higher than the initial price, or the initial trend was decreasing and the ending price was 
lower than the initial price at the beginning of the trend; 

• the fraction of incorrect predictions, where the initial trend was increasing and the last price 
was lower than the initial price, or the initial trend was decreasing and the last price was 
higher than the initial price; 

• the RMS Error / (Average length of the trends / m x ); and 

• and the RMS error * L s 

• the efficiency of the trends (%), where efficiency is defined as the average return of the 
trends (%) / average length of the trends; 

• compounded return of the trends (%) 

Each of these values is stored in the computer with its corresponding set of trend determination 
parameters ( m x and L s ). 

Selecting a set of useful trend determination parameters 

Referring again to Fig 1, at step 300 the values for each of the sets of trend determination 
parameters are evaluated in order to select one or more useful set of trend determination 
parameters for a particular time series data set. This step is based on the unexpected observation 
that trends, based on a given set of determination parameters, that fit one portion of the time 
series well also tend consistently to fit subsequent portions of the time series as well. 

In a semi-automated method of this embodiment, the RMS error is crossplotted against 
the average trend length and a subset of the more effective parameter sets are identified from that 
plot. Referring now to Fig 6, which is a plot of the product of the RMS error and the deviation 
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limit, L s , versus the average trend length, the lower line 705 represents a fit of a curve through 
the trend determination parameter sets that have long trends and low error. The points along or 
near this curve represent the optimum combination of low error and longer trends for the time 
series data set. The points that are closest to that line, particularly those points corresponding to 
longer average trends such as points 710, 720, and 730, are considered to be the most desirable 
for subsequent analysis of the time series data. In this embodiment, several values that have the 
maximum "Average Trend Length" for a minimum "RMS error * L s " are selected. More than 
one set of trend parameters is selected so that multiple trends can be generated. Generally two to 
three sets are selected for subsequent analysis, though other users may have different uses for the 
tool and may select more or less depending upon their purposes. Each trend picks up different 
features, and the trend produced by one set of trend parameters may be more useful during one 
period of time versus the trend produced by another set of trend parameters. 

In other embodiments, other types of error measures such as other X norms, where p is a 
real number, may be used. For example, the \ norm is very commonly used for robust 
estimation in problems that have large outliers (Tarantola, Albert, Inverse Problem Theory: Methods 
for Data Fitting and Model Parameter Estimation. E lsevier. New York, 1998.). There are numerous 
other measures of error that can be employed based on probability distributions and are not 
limited to X p norms. These include those based on a Lorentzian distribution, Andrew's sine, and 
Tukey's biweight (Press, William H., Brian P. Flannery, Saul A. Teukolsky, and William T. Vetterling, 
Numberical Recipes in C: The Art of Scientific Computing . Cambridge University Press, 1989.). In 
some embodiments, this semi-automated step of visual examination of the results can be replaced 
by an automation of the process by establishing one or more objective functions. In the case of 
this type of automation, there are numerous, well-known optimization techniques that may be 
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employed to find good parameter sets without the exhaustive generation of parameter sets 
described in the section above. 

Processing the time series with trend determination parameter sets 

Referring again to Fig. 1, when one or more trend determination parameter sets are 
selected, they are applied to process the time series and to generate the trends at step 400. The 
result of this step is a set of trends for each trend determination parameter set as each new data 
point is considered for the time series. 

Fig. 4 A is a detailed flowchart of the processing of a time series at step 400 for 
determining whether or not a new data point represents a continuation of a trend.. For each 
selected trend determination parameter set (m l ,L s ), the latest trend is updated with each new 
sequential value of data for the time series data set. In this embodiment, a trend is described by a 
best-fit polynomial curve through all of the data within the trend and some number of data values 
from the previous trend. As a consequence, the current trend is dynamic and will be updated as 
each value of new data arrives. Once the trend changes, the previous trends are no longer 
dynamic. 

A new trend is defined to have begun when one of the following occurs: 

• The derivative of the trend changes from positive to negative or vice versa; or 

• The number of deviations that the difference between the last closing price or sequential data 
element and the predicted trend value meets or exceeds L s , the deviation limit, and the 
deviation is in the opposite direction to that of the trend. If the difference meets or exceeds 
4 , but the deviation is in the same direction as that of the trend, then the trend is maintained. 
The reason for this is to maintain longer trends. There is less confidence in shorter trends. In 
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some applications, such as financial management, the determination that new time series data 
is consistent with a longer upward or downward trend is more important than whether the 
magnitude of that trend has changed. In other applications, it is more important that the data 
be fitted better by a new trend, so the trend wouldn't be maintained. 

Referring to Fig 4A and 4B, the processing is accomplished through the following steps: 
In step 41 0, load the time series, y l } ,j = l,N l9 where N t is the number of elements in time 
series /. 

Initialize the trend determination parameters in step 420. The trend determination 
parameters are m { , the first window size; L s , the deviation limit; and m 2 , the second 
window size. The first window size is the minimum number of data points needed to define 
a trend. In this embodiment, the deviation limit is the number of deviations away from the 
trend that the next day's closing price or additional data value must be to signal a new trend. 
The deviations are defined as a measure of the spread of a distribution. Common statistical 
measures of spread of a distribution are variance, standard deviation, inter-quartile range, and 
range between the minimum and maximum values. In this patent application, L s refers to 
any measure of spread of a sample of values. In this embodiment, the second window size is 
equal to m x for the first iteration, and is equal to n + m x for subsequent iterations where n is 
the length of a trend. This is the number of data values at the end of the trend's time series 
that are used to calculate a test measure of spread. 
Set 7, the time series index, to m x + 1 in step 430. 
Set n, the number of points in the current trend to 0 in step 440. 
For each trend, check to see if the current value, y l } is in the trend in steps 450-530. 
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For the first trend 

• In step 450, select, m x values from the beginning of the segment of interest in the time 
series. 

• In step 460, calculate a best-fit curve / (x), through the m 2 data points, 

i x t*>yi* I x i,k = [* ~ 0' " m 2 ) + ll * = 0 -m 2 \j~\. The subscript; in f j (x) refers to 

the function estimate at index j, when evaluating whether y l} is in the trend or not. In 

the preferred implementation, least squares regression is used to determine a best-fit 
polynomial through the data points. However, the curve in this patent application is not 
restricted to a polynomial function nor to a polynomial function of any particular order. 
The curve can be another mathematical function, such as an exponential or logarithmic 
function. It could also be the estimate derived from a neural network or Kalman filter. 
Least squares regression (X 2 norm) is the preferred method used to calculate the curve, 

/ (x), but this is not restricted to a A, 2 norm. The invention is patent application includes 

other methods that can be used to determine the fit of a curve to a set of points. This 
includes other X p norms, where p is a real number. 

dfj(x) 



In step 470, evaluate the derivative 



at the point x i} _ x = m 1 and obtain an 



dx 

estimated value of the curve, fj{x itj ) at index j\ Note that the derivative is also 
calculated at index /, where x Uj =m 2 +l* 
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In step 480, calculate the correlation coefficient (R) between the pairs of values, 
(y<,A » fj ( x i,k )\ k = (j ~ m 2 ), j - 1 . The correlation coefficient is not critical to the 
process, but it is useful diagnostic information that is output for further analysis. 
Calculate the residuals, d k , between the time series values, y t J , and the trend values, 

fj i x >,j ) in ste P 4 9°- Although it is unnecessary in most cases, it is sometimes desirable 
to normalize the residuals, such as by dividing by the trend values. The purpose of this 
normalization is to ensure homoscedasticity of the deviations. If the series is trending up 
or down within a single trend, then the non-normalized deviations at the beginning of the 
trend will have a different variance than the non-normalized deviations at the end of the 
trend. Alternatively, other methods of normalization may be employed, such as dividing 
by a moving average of the trend. 



d k = 



» k = {j-m 2 \j-\ (1) 



Calculate the standard deviation, s M , of the residuals, d k in step 500. The standard 
deviation is used in this embodiment; however, it is only one of many measures of the 
spread of a distribution. The invention includes other measures of spread, such as the 
variance, range, inter-quartile range, root mean square, differences between any quantiles 
of a distribution, or a measure of spread from a neural network. 
Calculate the deviation between the predicted trend value and the actual value, y t . at 
x hJ in step 510. The invention includes either normalizing by dividing by the trend 
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value, fj (x u ), or not normalizing. Other methods of normalization may be employed, 
such as dividing by a moving average of the trend. 



• Normalize the deviation, d } in step 520. 



.(2) 



J / s 



7-1 



•(3) 



Test to determine whether the trend has changed at step 530. In this embodiment, the trend 
changes if the sign of the first derivative, d } , has changed from the previous iteration to 
the current iteration (equation 4): 



If 



< sign 


dfj(x) 




* sign 






dx 




dx 


> 








X iJ-2 



, then true . 



•(4) 



The trend also changes if the normalized deviation, d\ , exceeds L s in the opposite 
direction to that which the trend is going. In an alternate embodiment, the trend may be 
determined to have changed if only the absolute value of the normalized deviation 
exceeds the deviation limit. 



If U 



[abs (</;)> L S ]AND 



dfj(x) 



dx 
dfj(x) 



>0 



AND (d'j < o) 



dx 



<0 

x l.j ) 



OR 



AND (d'j > 0) 



► , then true 



.(5) 



• If the trend does not change at step 530, then increment n to n + 1 at step 550. 
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• If the trend does change at step 530, then set n = 0 at step 540. 

• Increment j at step 560. 

• At step 570, if j < N, , then repeat steps 450-560 for the next data point in the data set. If 

the last point of the time series is still within the first trend, then go to step 600 and 
calculate trend attributes. 

For subsequent trends 

• Select m 2 values at step 450. m, of the values are from the end of the previous trend, 
and n values are from the current trend. Calculate the best-fit curve, / (x), through the 
m 2 data points at step 460. 



In step 470, evaluate the derivative 



at the point x iM = m 2 and obtain an 

X iJ-l 



dx 

estimated value of the curve, f. (x iyJ ) at index/. The derivative may also be calculated 
at index j, where x tj -m 2 +l. 

► In step 480, calculate the correlation coefficient (R) between the pairs of values, 
ba>/,(*a)l k = {j-m 2 ),j-l. 

» Calculate the residuals, d k , between the time series values, y tJ , and the trend values, 

fj { x i,j ) in step 490. Optionally, the residuals may be normalized as described above. 

Calculate the standard deviation, , of the residuals, d k in step 500. 

Calculate the deviation between the predicted trend value at step 51 0, as described 
previously. 

Normalize the deviation at step 520, as described previously. Test to determine whether 
the trend has changed. 530, as described previously. If the trend changes then set n = 0 at 
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step 540. If the trend doesn't change, then increment n at step 550- Increment j at step 



560. 

• At step 570, if j < N i , then repeat steps 450-560 for the next data point in the data set. If 
the last point of the time series has been reached ( j > N i ), then go to step 600 and 
calculate trend attributes. 

The procedure preferably outputs the following arrays for each trend parameter set 
There are 7V\ elements in each array. They can either be analyzed by themselves or output to a 
post-processing procedure to calculate statistics on the trends as shown in Fig. 5, 

• Date or index array 

• Data array ) y = 1, AT, . 



• Trend codes array 

• d f , the array of normalized deviations from the trend. 

• Array of minimum closing prices allowed based on trend 

• Array of maximum closing prices allowed based on trend 

• Array of the first derivatives of the dynamic trend 

• Array of the first derivatives of the normalized dynamic trend. The data values at the 
beginning of the trends are normalized to one, so that the initial trend data value is one for all 
trends. The derivative of the trend fit to the normalized data values can be compared to the 
derivatives of the other trends for filtering purposes. Alternate methods of normalization 
may be used as described previously. This can include: a) dividing the time series values in 
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the trend by its mean or median; b) ranking the values in the trend and using the ranks instead 
of the time series values themselves in the regression; or c) calculate the Fourier transform of 
the time series values in the trend, zero the zero-th frequency contribution, and back- 
transform the series back to the time domain. 

• Array of the first derivatives of the final trend. 

• Array of correlation coefficients (R) of the final trend line through the data values for each 
index L 

• The array of final trend line values once a trend has been finalized. 

• An array of the differences between the data values and the trend values. 

Fig. 6 represents trends fit to a time series. The data that were used to select the trend 
parameters are the closing prices of Dell Computer Corporation from January 1, 1994 through 
January 1, 1999. The parameters were then applied to the closing prices from January 1, 1994 
through January 23, 2001. 

Determining attributes of each trend 

Referring again to Fig 1, after determining whether a new point represents the 
continuation of a current trend, a number of attributes of each of the trends are calculated or 
updated in step 600. For each of the set of trend determination parameters, each trend is 
characterized. 

Referring now to Fig. 5, which is a post-processing chart for the trends of a time series, 
the trends are counted in step 610, and statistics for each of the trends are calculated in steps 610- 
710. The statistics include: 

• Determining the beginning date or index for each trend at step 620; 

• Determining the ending date or index for each trend at step 630; 
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• Determining the beginning data value in each trend at step 640; 

• Determining the ending data value in each trend at step 650; 

• Determining the trend length at step 660; 

• Determining the average trend correlation at step 670; 

• Setting a flag at step 680 to indicate the direction of the trend, where up = +1 , flat = 0, and 
down = -1; 

• Determining the fraction of changes in data values that were increasing relative to the 
previous data value for each trend at step 690; 

• Determining the fraction of changes in data values that were decreasing relative to the 
previous data value for each trend at step 700; and 

• Determining the average slopes or first derivatives of each trend at step 710. 

In this embodiment, a series of arrays is output, each containing N Trends elements, where 
N Trends is the number of trends derived from the time series. 

Implications of the End of a Trend 

One of the uses of this invention is to provide an unbiased method for assessing whether 
the fluctuations in the prices of a financial instrument are normal fluctuations around a trend, or 
whether they are indicative of a change in the trend itself. In the first case, negative deviations 
from the trend provide buying opportunities if the trend is positive. In the second case, where 
the tool would provide an indication that the trend itself is changing; a change in the trend would 
provides an opportunity to reassess the potential direction of prices for a financial instrument. 
Other tools, such as the fundamental analysis of a stock's potential could be assessed to 
determine whether a position in a stock should be changed. For example, assume that a stock is 
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in an uptrend. A downward change in the trend would provide a signal that the trend has 
changed and that the position needs to be re-evaluated. In another example, if the stock has a 
positive fundamental position, but the stock is in a downtrend, this tool would be used to assess 
when the downtrend has ended and signal an opportunity to purchase the stock at an even 
5 cheaper price. 

DETAILED DESCRIPTION OF ALTERNATE EMBODIMENT - Non-Constant Interval 

Between The Samples In A Vector 
;*f This alternate embodiment relates to steps 200 through 400. It is an alternative method 

\k for processing time series datasets with vectors of values that have non-constant spacing between 
(1! the values. Instead of a time series being represented by y , j = 1, JV, , a vector is now 

!L% represented by {x itj , y i} \ j = 1, N i , where x i} represents some measure of the location or time 

111 for each sampled data value y uj . 

For example, {xij 9 y t j \ j = 1, N t can represent the times and prices for individual 

1 5 trades that arrive at a non-constant interval of time. 

Selecting a Vector Data Set 

In this embodiment, as in the first embodiment, a plurality of vector data sets is analyzed 
in step 100 to identify one or more data sets for further analysis. The difference is that the values 
20 in the vector are no longer at a constant spacing. Therefore, the last M\ data elements are no 
longer applicable, because the last M\ data elements would represent different amounts of time, 
distance, or other variable that is used to represent the location x t j of each of the data values 

y u . Therefore, instead of using a constant number of last points, it is desirable to use a constant 
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measure of x iyj called AX, and a minimum number of points that are necessary to fit the initial 
curves, M Min . The number of points that are in the time span of AX and are greater than M Min 
will be referred to as M t . A curve will be fit through the data elements 
{ x ij>yij) = { x i,N,-M 1+ j>yi, Nl -M 1+ j \j = h M t using multiple regression. 

As in the first embodiment, the normalized derivatives and correlation coefficients are 
recorded. Upon such analysis of each of the data sets, a data set is selected for further analysis. 
When identifying financial instruments to trade, a vector that has a large increase or decrease in 
normalized derivative with a correspondingly large absolute value of the correlation coefficient 
would be a likely candidate for subsequent processing. Vector data sets that have a small slope 
would generally be avoided. 

Referring now to Fig. 2, which is a more detailed flowchart of the data set selection steps, 
the initial search is performed through the following steps for each time series data set i: 

• In step 110, the each vector data set, {x t J , y tJ \j = l,N., where N, is the number of 
elements in vector, is loaded into the processor. Note that a mathematical transform of a 
vector is also a vector, (i.e. (x tJ , y" u ) = (* . . , ln(y . )), j = 1, N t is also considered to be a 
vector). 

• In step 120, an initial window size AX , is read by the processor, and the last M, data 
elements, where M, > M Mln , are selected from the vector data set. 

( x u>ytj)= ( x i.N,-M 1 *py l ,N,-M 1+ j \j=h m { . 

• In step 130, the series of the last M, data elements is normalized by dividing each data 
element by y iA , so that the first data value is 1.0. The normalized vector is designated as 
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y f , where y 9 ui = 1 . The normalization is performed in order to permit sorting of the data 
sets on a consistent basis, such as the slope of a line fit through the last M. data elements. 
Alternate methods of normalization may be used such as: a) dividing the vector by its mean 
or median or b) ranking the values in the vector and using the ranks instead of the vector 
values themselves in the regression. 

• In step 140, a line, y'. . = a\x Uj + b\ , is fit through the M i data paints elements ( x Uj , y' Uj ) 

j = 1, M. , using linear regression. The slope of the line, a\ , is stored on the processor so 
that it may be used as a time series data set selection criterion. Alternate methods of data 
fitting may be used such as higher order polynomial regression or nonlinear regression. In 
this case, the average of the first derivatives would be stored on the processor as a\ . 

• In step 150, if there are remaining vector data sets, steps 110-140 are repeated. 

After each data set has been analyzed in steps 110-140, the results are reviewed in step 
160 as in the first embodiment 

GeneratinR the trend determination parameters 

Referring again to FIG. 1, once a time series data set has been selected and loaded in the 
processor, the trend determination parameters are selected at step 200. Inherent in this step is a 
processing of a portion of the time series to derive the parameters. The parameters include_the 
Initial Window Size (m l ) and Deviation Limit (L s ) as discussed in the first embodiment, and an 
additional parameter, Initial Window Length ( AX t ), which is the size of the first window. This 
parameter is the minimum length of data needed to define a trend. It must have more than m x 
number of elements. In this embodiment, m x acts only as the minimum number of elements that 
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must be in AX t . If this method is being applied to tick data for example, a value of m 1 = 30 
over a time interval, AX 1 = 30 minutes would represent reasonable values. 

Each set of trend determination parameters in combination with the particular data fitting 
procedure, such as polynomial regression, produces a unique set of trends for a vector data set. 
At this step of the method, many different sets of trend determination parameters are used to 
produce corresponding sets of trends. These multiple sets of trends are then evaluated to 
determine which of the sets are better at matching the current data from the vector data set. 

The trend determination parameters can be selected in several ways. In this embodiment, 
a subset of the vector, the first M 2 data points, representing some length AX 2 of the vector, 
where N, is the number of data elements in the entire vector data set under evaluation, are 
selected for defining the trend determination parameters. However, the vector is not limited to 
the preferred implementation. The parameters can be derived from any vector including other 
financial vectors as well as one or more simulations of the vector. In this embodiment, the 
parameter selection is manual as in the first embodiment. 

Referring now to Fig. 3, which is a detailed flowchart of the procedure for deriving the 
trend determination parameters. A set of trend determination parameters is generated in step 200 
by looping in increments between minimum and maximum values for each of the trend 
determination parameters. The process is the same as in the first embodiment, except that 
M1MIN, M1MAX, and M1INC refer to the Initial Window Length ( AA^ ). 
Selecting a set of useful trend determination parameters 

Referring again to Fig 1, at step 300 the values for each of the sets of trend determination 
parameters are evaluated in order to select one or more useful sets of trend determination 
parameters for a particular vector data set. This process is the same as in the first embodiment. 
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Processing the vector data set with trend determination parameter sets 

Referring again to Fig. 1, when one or more trend determination parameter sets are 
selected, they are applied to process the vector data set and to generate the trends at step 400. 
The result of this step is a refreshed set of trends for each trend determination parameter set as 
each new data point is considered for the time series. 

Fig. 4A is a detailed flowchart for determining whether a new data point represents a 
continuation of a trend or not. For each selected trend determination parameter set ( AX l , L s ), 
the latest trend is updated with each new sequential value of data for the vector data set. As in 
the first embodiment, a trend is described by a best-fit polynomial curve through all of the data 
within the trend and some length of values from the previous trend. As a consequence, the 
current trend is dynamic and will be updated as each value of new data arrives. Once the trend 
changes, the previous trends are no longer dynamic. 

A new trend is defined to have begun as described in the first embodiment. 

Referring now to Fig 4A, which is a detailed flowchart of the processing of a time series 
at step 400 to determine the trends for a given trend determination parameter set ( AX X 9 L S ) . The 
processing is accomplished through the following steps: 

• In step 41 0, load the vector, (x . , , y u \j = l 9 N n where N, is the number of elements in 
vector /. 

• Initialize the trend determination parameters in step 420. The parameters are hX x , the 
Initial Window Length; L s , the deviation limit; and AX 2 , the second window size. In this 
preferred embodiment, AX 2 is equal to AX, for the first iteration and n + AX t for 
subsequent iterations, where n is the number of points in a trend. This is the length of data 
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values at the end of the trend's vector data set that are used to calculate a test measure of 
spread. 

Set j to Am + 1 in step 430. 

Set n, the number of points in the current trend to 0 in step 440. 

For each trend, check to see if the current value, (x fJ , y tJ ) is in the trend in steps 450-570. 
For the first trend 

• In step 450, select. AX 2 length of values from the beginning of the segment of interest in 
the vector data set. Because the number of data points represented by AX 2 will probably 
be variable, represent the number of data points represented by AX 2 be Am . 

• In step 460, calculate a best-fit curve, f } (x), through the Am data points. 

(*/,* > yuu \ x iJt =[*-(/- Am) + 1], * = (j - Am), j-1. .The subscript j in f } (x) 
refers to the function estimate at index j, when evaluating whether (x u , y, y ) is in the 
trend or not. 

K* -/,(*.,*)), 



d,, = 

k 



, k = (j - Am), j-1 



(6) 



Calculate the standard deviation, , of the residuals, d k in step 500. This is similar to 
what is described in the first embodiment, except that there is a difference in the 
calculation of the statistics. The normal equation of the standard deviation is: 



Am 



•(7) 
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where d is the average of the d k values. However, this assumes a constant 

spacing between the sample values represented by d k . Because the values in the 

vector are not sampled on a constant spacing, the values must be weighted to 
account for this non-constant spacing. 

s j-i=hL w k( d k-d') 2 (8) 

where d' is the weighted average of the d k values. 

— Am 

rf ' = £(»"*<**) (9) 

k=l 



^ { X i,k X i,k-1 ) + 2 i X iMl ~ X Uk ) 
{ X i,Am ~ X i,l ) 



w * =- 7 ,A = 2,(Am-l) (10) 



t(**.2-*m) 



w » = L ) 



"Am = 



2 (*/ **7,Am-l ) 



U ) w 

Am 



The weighted population standard deviation is used in this embodiment; however, this 
is only one of many measures of the spread of a distribution. This patent includes, but is not 
limited to, other measures of spread, such as the sample standard deviation, the population or 
sample variance, range, inter-quartile range, differences between any quantiles of a 
distribution, or a measure of spread from a neural network. 
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• Steps 510 through 570 are the same as in the first embodiment with the modifications to 
steps 450 through 500 as described previously. 

For subsequent trends 

• Select A/w + 1 values at step 450. AX t length of the values are from the end of the 
previous trend, and n values are from the current trend. 

• Calculate the best-fit curve, f 3 (x), through the Am data points at step 460. 



df (x) 

• In step 470, evaluate the derivative 1 



at the point x i hl and obtain an estimated 



dx 

value of the curve, f } (x tJ ) at index y. 

• In step 480, calculate the correlation coefficient (R) between the pairs of values, 

• Calculate the residuals, d k , between the time series values, y , and the trend values, 

fj ( x tj ) in ste P 490 - This is the same as in the first embodiment, except that m 2 has 
been replaced by Am . 

• Calculate the standard deviation, , of the residuals, d k in step 500 using equation 3. 
The weighted population standard deviation is used in this embodiment, however, this is 
only one of many measures of the spread of a distribution. The invention includes other 
measures of spread, such as the sample standard deviation, the population or sample 
variance, range, inter-quartile range, differences between any quantiles of a distribution, 
or a measure of spread from a neural network. 

Steps 510 through 570 are the same as in the first embodiment with the modifications to 
steps 450 through 500 as described previously. 
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The procedure preferably outputs the same arrays for each trend parameter set as 
described in the first embodiment. The only difference is that instead of exporting the data array, 
hui lj = 1 i N n the routine will export the data pairs arrays, (x iJ9 y {J ), j = 1,7V. . 

Determining attributes of each trend 

As in the first embodiment, a number of attributes of each of the trends are calculated or 
updated in step 600. 

Referring now to Fig. 5, which is a post processing chart for the trends of a time series, 
steps 610 through 710 are the same as in the first embodiment, except for: 

• Determining the beginning time or location for each trend at step 620; 

• Determining the ending time or location for each trend at step 630; 

• Determining the average trend correlation at step 670; This will be a weighted average as 
described above in step 500. 

• Determining the average slopes or first derivatives of each trend at step 710. This will be a 
weighted average as described above in step 500. 

9 

DETAILED DESCRIPTION OF ALTERNATE EMBODIMENT -. Time series data elements 
with multiple new data values 

This embodiment refers to step 200 through 400 in Figure 1. It is alternative method to 
describe the ability to consider adding multiple values to the trend at once versus only adding a 
single value at a time. 

The difference is that instead of considering data elements to be individual points: 
( x u ' y^j )>J = h N i > a data element is an aggregate of points within some neighborhood. For 
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example, let (x' lJt y' lt j), j = 1, N a refer to aggregates of points, where N a is the number of 
aggregate points under consideration. x' i } is a central measure of the location of the aggregate 
points, and y' U] is an equivalent measure of the value of the aggregate of points. The central 
measures to use in considering the points would be mean, median, or mode. Each aggregate 
is considered in steps 200 through 400 the same as an individual point (x u , y u . ) 
described in the first embodiment. 

DETAILED DESCRIPTION OF ALTERNATE EMBODIMENT - Alternate trend type curves 
This embodiment refers to the method of fitting a trend or a curve to a portion of a time 

series or vector in step 140 in Fig. 2, and in step 460 in Fig. 4A. 

In the description of the first embodiment, a polynomial as a trend to fit to the data 

points. The trend is not limited to a polynomial, nor to a polynomial of any particular order. 

This embodiment covers other types of trend curves. The curve can be another mathematical 

function, such as an exponential or logarithmic function. It could also be the estimate derived 

from a neural network or Kalman filter. 

The trend may be represented as a polynomial curve by a function with parameters, such 

as fj (x) = a 0 + a x x + a 2 x 2 + a 3 x 3 + A , where the parameters of the polynomial are the 

coefficients, a k . Alternately, the trend may be represented as an exponential equation, such as 

b x e 2 , where the coefficients are b 09 b 1 ,b 2 . Alternately, the trend may be represented as a 

logarithmic equation such as fj(x)= c 0 + c t Iog(c 2 Jc) where the coefficients are c 0 ,c 19 c 2 , and 

the logarithm is of any base including base 10, a natural logarithm, or other base. 
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A neural network can also be used to fit an estimated curve through a series of data 
points. There are many similarities between statistical tools and the function of a neural network 
(Sarle, W. S. ; "Neural Networks and Statistical Models" in Proceedings of the Nineteenth 
Annual SA S Users Group International Conference, AnriL 1994 . pp. 1538-1550. 

5 ftp://ftp.sas.com./pub/neural/neurall .ps.) 5 even though the designer and user of the neural 
network may not be aware of them. As a consequence, a neural network may be used to fit a 
trend function to a time series data set or a vector data set. This embodiment covers the function 

! * : of a neural network for this purpose. 

u A Kalman filter is a type of least squares filter that can also be used to fit a trend to a time 

lift series data set or vector data set. This embodiment covers the function of a Kalman filter for 
Q this purpose. More about Kalman filters can be found in Maybeck (Maybeck, Peter S., 
; ^ Stochastic Models. Estimation, and Control: Volume L Academic Press, New York, 1 979.) 
;^ This embodiment is not limited to the mathematical functions described here. As known 

p to one skilled in the art of data fitting, there are numerous mathematical functions that could be 
15 used to fit a trend to a time series or vector data set as well as hybrids that can include 
mathematical functions as well as a neural network for example. 

DETAILED DESCRIPTION OF ALTERNATE EMBODIMENT - Normalization of Deviations 
20 by Trend 

This embodiment refers to the method of normalization of the residuals or deviations by 
the trend value in steps 490 and 510 in Fig. 4A. 

In the description of the first embodiment, the deviation of the data values from the trend 
curve is normalized by the trend curve value, f } (x tJ ). The purpose of this is to ensure 



35 

homoscedasticity of the deviations. If the series is trending up or down within a single trend, 

then the non-normalized deviations at the beginning of the trend will have a different variance 

than the non-normalized deviations at the end of the trend. 

However, this also works well in most cases without the normalization, and this 

embodiment covers the case of not normalizing by dividing by the trend. I.e. 

d *=b>i*-fj(x iJk )\ k = (j-m 2 \j-\ (13) 

Alternatively, other methods of normalization could be employed. For example, instead 

of dividing by a single trend value, the deviation may be normalized by dividing by a moving 

average of the trend. 

DETAILED DESCRIPTION OF ALTERNATE EMBODIMENT - Alternate Normalization 
Methods 

This embodiment refers to the method of normalizing a subset of the time series or vector 
data set in steps 130 in Fig. 2 and 400 in Fig. 4A. 

In the description of the first embodiment, a portion of the time series is normalized by 
dividing all of the time series or vector data set values by the first value so that y' gl = 1 , where 
the normalized time series is designated as y' . The normalization is performed in order to 

permit sorting of the data sets on a consistent basis, such as on the average of the first derivatives 
of a curve fit through M\ data elements. Alternate methods of normalization may be used such 
as dividing the time series its mean or median; ranking the values in the time series and using the 
ranks instead of the time series values themselves in the regression; or calculating the Fourier 
transform of the time series, zeroing the zero-th frequency contribution, and back-transforming 
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the series back to the time domain. As known to one skilled in the art of data analysis, 
normalization is not limited to these methods. 

For example, one of the outputs of step 400 is an array of the first derivatives of the 
normalized dynamic trend. The derivative of the trend fit to the normalized data values can be 
5 compared to the derivatives of the other trends for filtering purposes. The alternative methods 
of normalization described previously can also be applied to produce these values. 

II DETAILED DESCRIPTION OF ALTERNATE EMBODIMENT - Measure of Spread of 
If| Distribution 

: : 5 1 This embodiment refers to the method of calculating a measure of the spread of a subset 

of the time series or vector data set in step 500 and the use of the deviation limit, L s , in step 420 
\*z in Fig. 4A. 

In the description of the first embodiment, the standard deviation is used to calculate the 
15 spread of the residuals, d k . Other measures of the spread of a distribution that can be used 

include variance; range; inter-quartile range; differences between any quantiles of a distribution; 
or a measure of spread from a neural network. 

As known to one skilled in the art of data analysis, other measures of spread may be used. 
If these other measures of spread are used, then the deviation limit's definition must be 
20 generalized to account for these other measures of spread. 

DETAILED DESCRIPTION OF ALTERNATE EMBODIMENT - Trend Determination: Single 
25 vs. Multiple Time Series or Vector Datasets 
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This embodiment refers to the time series or vector data sets that is used to derive the 
trend determination parameters in step 200, 300, and 400 in Figs.l and 3. 

In the first embodiment, the trend determination parameters were derived from a portion of the 
time series or vector data set. M 2 elements from the beginning of the time series data set, 
y u ,j = l,N l9 were selected for processing to get the trend determination parameter set. 

However, the time series or vector data set is not limited to the first embodiment. The 
parameters can be derived from any time series or vector data set including other financial series 
as well as one or more simulations of time series. For example, if there are two time series that 
are highly correlated, the trend determination parameter can be derived and used for one of the 
time series, but also used for the other. In addition, one or more stochastic simulations of the 
time series or vector data sets can be used to derive the trend determination parameters. Multiple 
stochastic simulations can provide a more robust and refined estimate of what the parameters 
should be. 

This embodiment includes these other sources of time series or vector datasets for the 
derivation of the trend determination parameter set. 

DETAILED DESCRIPTION OF ALTERNATE EMBODIMENT - Alternatives to the Deviation 
Window Size (m 2 ) 

This embodiment refers to an additional trend determination parameter (m 2 ) that is used 
in steps 200, 300, and 400 in Figs. 1 and 3; and 420, 450 - 490, and 500 in Fig. 4A. 

In the first embodiment, this trend determination parameter was a function of m x , the first 
window size, and n 9 the number of data values from the current trend. In this respect, it was not 
variable, but simply a function of the two other parameters. 
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In this embodiment, m 2 can be variable within the range 2 < m 2 < j - 1 , Fig. 8 is a 
modification of Fig 3 where step 200 has been replaced by step 210. A nested loop has been 
added to find the optimum parameter determination value for m 2 in step 210. 

Referring to Fig. 8, which is a detailed flowchart of the procedure for deriving the trend 
5 determination parameters, a set of trend determination parameters is generated in step 210 by 
looping in increments between minimum and maximum values for each of the trend 
determination parameters. In this embodiment, three trend determination parameters are used- 
Jf the Initial Window Size (m x ) which is evaluated between a starting value M1MIN and an ending 
i ll value Ml MAX in an increment Ml INC; the Deviation Limit ( L s ) which is evaluated between a 
IP starting value LSMIN and an ending value LSMAX in an increment LSINC; and a Deviation 
Window Size ( m 2 ) which is evaluated between a starting value M2MIN and an ending value 
m M2M AX in an increment M2INC. The order of the nesting is not important Typical values for 
O these variables are : 

M2MIN - 2 
15 M2MAX = 70 

M2INC = 1 

M1MIN = 3 

M1MAX-70 

M1INC-1 
20 LSMIN = 1 

LSMAX = 20 

LSINC = 0.5 

The trend determination minimum, maximum, and increment parameters are determined 
25 through experience. If either of the selected trend determination parameter values are equal to 
Ml MAX, M2MAX, or LSMAX for a selected trend set, then this would indicate the need to 
increase the LSMAX, M1MAX, or M2MAX values. The lower bound Initial Window Size, 
M1MIN, is limited by the order of the polynomial that one is using for the trend. For a linear 
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trend (a line) one needs at least two points to fit a line. For second-order polynomials, one needs 
three points to fit a curve to the data points. The lower bound Deviation Window Size, M2MIN 
is limited by the number of points necessary to calculate a spread between two points or away 
from some central value. 

In step 210, these values are generated in a nested loop resulting in approximately 
175,000 sets of trend parameters. As in the first embodiment, the following values are calculated 
and exported the number of trends in the subset of the time series ( N Trends ); the RMS Error 
between the input data values and trend values; the average length of the trends; the average 
trend length / m x ; the RMS Error / (Average length of the trends / m x ); and the RMS error * L s . 
Each of these values is stored in the computer with its corresponding set of trend determination 
parameters (m l9 m 2 , and L s ). 

In Fig. 4A, the additional parameter, m 2 , will be loaded with the others in step 420, not 
as a function of parameters m x and L s , but as its own independent parameter. Instead of using 
m 2 in steps 450, 460, 470, and 480, (m x +ri) is used instead. m 2 directly affects how many 
deviations are calculated in step 490, and it is the number of deviation values that are used in the 
standard deviation calculation in step 500. 

DETAILED DESCRIPTION OF ALTERNATE EMBODIMENT » Automatic methods of 
Parameter Selection 

This embodiment refers to step 200 and 300 in Fig. 1. It is alternative method to 
manually selecting the trend determination parameters. 
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Generating the trend determination parameters 

Referring again to FIG. 1, once a time series data set has been selected and loaded in the 
processor, the trend determination parameters are selected at step 200. Inherent in this step is a 
processing of a portion of the time series to derive the parameters. The parameters (m x ,L S ) are 
the same as in the first embodiment. Alternatively, they can be ( AX, , m x , L s ) as described in 
the second embodiment. 

Inherent in step 200 is step 400. Step 400 is the same as in the first and second 
embodiments. What is changing in this embodiment is the structure of step 200 to choose the 
optimum parameters. 

The goal is to find the set of parameter values ( m l , L s ) or ( AX, , m^LJ whose trends 

best fit the data. This involves minimizing some variable that generally includes an error term 
such as RMS Error. 

As in the first embodiment, a subset of the time series, the first M 2 data points of the 
time series, where N t is the number of data points in the entire time series data set under 
evaluation, are selected for defining the trend determination parameters. 

As described in the first embodiment, step 200 outputs a number of derived values related 
to the trends and the predictive error for each parameter set. Other derived values can also be 
produced, such as (RMS Error) / N Trends ; the RMS Error / AX, ; RMS Error / (Average length 
of the trends / AX, ); (RMS error * L s ) I AY,; or (RMS error * L s ) I (Average length of the 
trends / AX, ). 

Any one of these variables may be minimized with respect to the input trend 
determination parameters: (m x ,L s ) or (AX,, m x ,L s ). The error variable, such as RMS Error, 
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may also be combined with other variables as outlined above to define a cost function to be 
minimized. The parameters may then be selected automatically using a local optimization 
algorithm, such as steepest descent or conjugate gradient, or by using a global optimization 
algorithm, such as simulated annealing, genetic algorithms, or any hybrid thereof. Optimization 
procedures are well known in the art, as outlined in reference texts like Chapter 10 of Press et al, 
"Numerical Recipes in C: The Art of Scientific Computing" (1989), Nocedal, Jorge and Stephen 
J. Wright, Numerical Optimization . Springer- Verlag, New York, 1999; Miller, Ronald E., 
Optimizati on: Foundations and Applications . John Wiley & Sons, Inc., New York, 2000 and 
Chong, Edwin K. P. and Stanislaw H. Zak, An Introduction to Optimization . John Wiley & 
Sons, Inc., New York, 1996. 

DETAILED DESCRIPTION OF ALTERNATE EMBODIMENT - Other measures of fit 

This embodiment refers to the error measure that is used in steps 200 and 400 in Fig, 1 . 

It is alternative measure of how well the trends match the data. 

In the description of the first embodiment, the RMS Error, a least squares measure, was 

used to define the error between the data points and the trend values. The error is not limited to 

being defined by the RMS error. This embodiment covers other methods that can be used to 

determine the fit of the trends to a set of points. 

Other types of error measures such as other X p norms, where p is a real number, may be 

used. The definition of the weighted X p norm is (Tarantola, 1998): 



i 
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where a. are weights. If a t = 1 for all z, then that defines an unweighted X p norm. Other 
measures could remove the j superscript on the above equation. 

For example, the X x norm is very commonly used for robust estimation in problems that 

have large outliers (Tarantola, 1998). There are numerous other measures of error that can be 
employed based on probability distributions and are not limited to X p norms. These include 

those based on a Lorentzian distribution, Andrew's sine, and Tukey's biweight (Press et al, 
1989). 

DETAILED DESCRIPTION OF ALTERNATE EMBODIMENT - Selection of parameter set 
by optimization of objective function 

This embodiment refers to the method of fitting a trend or a polynomial to a time series in 
steps 140 in Fig. 2, and step 460 in Fig. 4A. Here are described alternative methods of fitting a 
trend or a polynomial to a time series. 

In the description of the first embodiment, least squares regression was used to fit a 
polynomial to the data points. The method of fitting a trend to a time series is not limited to 
polynomial regression or non-linear regression. This embodiment covers other methods that can 
be used to fit trends to a set of points. 

The coefficients, a k of a polynomial curve , f } (x) = a 0 + a t x + a 2 x 2 + a 3 x 3 + A , or the 
coefficients, b Q ,b t ,b 2 of an exponential equation f } (x) = b Q 4- b x e blX can be determined by 
methods other than least squares regression. 

In this embodiment, an error function is defined between the data values in the time series 
or vector y , and the function that is being fit to it, /. (*). The error function can be the RMS 
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error or another form as described in an alternate embodiment. The goal is then to minimize the 
value of the error function as a function of the coefficients or parameters of the function. 

The parameters or coefficients are selected automatically using a local optimization 
algorithm, such as, but not limited to, steepest descent or conjugate gradient or using a global 
optimization algorithm, such as, but not limited to, simulated annealing, genetic algorithms, or 
any hybrid thereof. Optimization procedures are well known in the art, as previously referenced. 

DETAILED DESCRIPTION OF ALTERNATE EMBODIMENT - Trends are broken if 
deviation exceeds L s only 

This embodiment refers to the determination that a trend has been broken in step 530 in 
Fig. 4A. In this embodiment, the test is modified to a single condition of whether the absolute value of 
the normalized deviation, dj , exceeds L s (equation 5): \abs {dj)> L s j . 

DETAILED DESCRIPTION OF ALTERNATE EMBODIMENT - new trend determination 
procedures or Correlation Coefficient Measure 

This embodiment refers to an alternate criterion to determine the end of a trend in steps 
200 and 400 in Fig. 1 and an alternative to steps 420 and steps 480 through 530 in Fig. 4A. 

In the first embodiment, normalized residuals were calculated between the trend and the 
time series that the trend was being fit to. The time series value that under consideration was 
normalized by dividing by the standard deviation of the normalized residuals. If that value 
exceeded a deviation limit, and it was in the opposite direction to that of the trend, then the trend 
changed (equation 5). In this embodiment, a correlation coefficient measure is used instead of 
the residuals. 
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As a result of the different process to control the change of trend, there is a change to the 
parameters that are being used. The Initial Window Size {m x ) does not change, but instead of 
the Deviation Limit ( L, ), a Correlation Limit ( L c ) is used, where L c is defined as the lower 
limit of the correlation coefficient can reach to signal a new trend. 

As a consequence, there is a slight change to how the trend determination parameters are 

selected in step 200 of Fig. 3 . Correlation parameters LCMIN, LCMAX, and LC1NC are used 

instead of LSMIN, LSMAX, and LSINC. Otherwise, the process of selecting parameters is the 

same. Typical values for these new parameters are: 

LCMIN = 0.1 
LCMAX = 0.95 
LCINC = 0.05 

The same variables are calculated and exported from step 300, except the trend determination 
parameters ( m x , L c ) are changed. 

In step 400, there are a few changes. A new trend is defined to have begun when one of 
the following occurs in step 530: (a) the derivative of the trend changes from positive to negative 
or vice versa, as in first embodiment; or (b) the correlation coefficient between the trend and the 
time series data values drops below L c , the correlation coefficient limit. 

The following steps have changed in step 400, and a modified diagram is shown in Fig. 9. 

• Initialize the trend determination parameters in step 420, where the parameters are m x , the 
first window size; Correlation Limit ( L c ), and m 2 , the second window size. 

• Step 480 has changed to include the value under consideration in the calculation, so, 
GYa * fj (*/,* )\ k = {j-m 2 \j. 

• Steps 490, 500, 510, and 520 are optional. 
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• Test to determine whether the trend has changed at step 530. In this embodiment, the trend 
changes if the sign of the first derivative has changed from the previous iteration to the 
current iteration. The trend also changes if the correlation coefficient, R ? falls below L c . 

DETAILED DESCRIPTION OF ALTERNATE EMBODIMENT - Statistical Process Control 
Alternative 

This embodiment refers to an alternate criterion to determine the end of a trend in steps 
200 and 400 in Fig. 1. It describes modifications to steps 420 and 440 and alternatives to steps 
200, and 520 through 560 in Fig. 4A. 

In the first embodiment, normalized residuals were calculated between the trend and the 
time series that the trend was being fit to. The time series value that under consideration was 
normalized by dividing by the standard deviation of the normalized residuals. If that value 
exceeded a deviation limit, L s , and it was in the opposite direction to that of the trend, then the 
trend changed (equation 5). In this embodiment, a number of values, L N , will have to exceed 
L s to signal a new trend. The L N values can be either consecutive or non-consecutive within a 
given trend. 

As a result of the different process to control the change of trend, there is a change to the 
parameters that are being used. The Initial Window Size (m l ) and Deviation Limit ( L s ) do not 
change, but another variable, the Number Limit (L N )v& added, where L N is the maximum 
number of values that can drop below the Deviation Limit, L s , to signal a new trend. 

Fig. 10 shows a modification of Fig. 3 to account for the additional parameter in step 200. 
Step 200 has been replaced by step 220. A nested loop has been added to find the optimum 
parameter determination value for L N in step 220. 
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The modification to the procedure as described in the first embodiment is the addition of 
a set of trend determination parameters. Referring to Fig. 10, which is a detailed flowchart of the 
procedure for deriving the trend determination parameters, a set of trend determination 
parameters is generated in step 220 by looping in increments between minimum and maximum 
values for each of the trend determination parameters. In this embodiment, three trend 
determination parameters are used- the Number Limit (L N ) which is evaluated between a 
starting value LNMIN and an ending value LNMAX in an increment LNINC; the Initial 
Window Size (m { ) which is evaluated between a starting value M1MIN and an ending value 
Ml MAX in an increment Ml INC; and the Deviation Limit (L s ) which is evaluated between a 
starting value LSMIN and an ending value LSMAX in an increment LSINC. The order of the 
nesting is not important. Typical values for these variables are: 

LNMIN - 1 
LNMAX = 10 
LNINC = 1 

M1MIN = 3 (for a second order polynomial) 

M1MAX = 70 

M1INC = 1 

LSMIN = 1 

LSMAX = 20 

LSINC = 0.5 

The trend determination minimum, maximum, and increment parameters are determined 
through experience. If either of the selected trend determination parameter values are equal to 
LNMAX, Ml MAX, or LSMAX for a selected trend set, then this would indicate the need to 
increase the LNMAX, M1MAX, or LSMAX values. The lower bound Initial Window Size, 
M1MIN, is limited by the order of the polynomial that one is using for the trend. For a linear 
trend (a line) one needs at least two points to fit a line. For second-order polynomials, one needs 
three points to fit a curve to the data points. The lower bound Number Limit, LNMIN is limited 
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by the how many points are needed to define a deviation that is larger than L s away from the 
trend. 

In step 220, these values are generated in a nested loop resulting in approximately 25,000 
sets of trend parameters. As in the first embodiment, the following values are calculated and 
exported: the number of trends in the subset of the time series ( N Trettds ); the RMS Error between 
the input data values and trend values; the average length of the trends; the average trend length / 
m l ; the RMS Error / (Average length of the trends / m l ); and the RMS error * L s . Each of these 
values is stored in the computer with its corresponding set of trend determination parameters 
(m l9 L N9 and L s ). The difference is that the new trend determination parameter that has been 
added. 

Fig. 4A is a detailed flowchart for determining whether a new data point represents a 
continuation of a trend or not. For each selected trend determination parameter set ( m l , L N , and 
L s ), the latest trend is updated with each new sequential value of data for the time series data set. 

A new trend is defined to have begun when one of the following occurs: (a) the derivative 
of the trend changes from positive to negative or vice versa as in the first embodiment; or (b) the 
number of times (LNCount) that the number of deviations that the difference between the last 
closing price or sequential data value and the predicted trend value meets or exceeds L s , the 
deviation limit, is counted. The deviation is also the opposite direction to that of the trend. If 
the difference meets or exceeds L s , but the deviation is in the same direction as that of the trend, 
then LNCount is not incremented. If LNCount is one, then this is the same as in the first 
embodiment. An alternative requirement is that the individual deviations must be consecutive to 
be counted. 
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Referring now to Fig. 4A, the following changes are made for this embodiment: 

• The additional parameter, L N , is loaded with the others in step 420. 

• Step 440 is modified to set the number counter, LNCount = 0. 

• The steps between 520 and 560 are modified as is shown in Fig. 1 1 . Steps 520 and 560 
remain unchanged. The following describes the changes 

• In step 521, test to determine whether the normalized deviation, d\ , exceeds L v in 

the opposite direction to that which the trend is going; if so then LNCount is 
incremented in step 541. 

• Step 530 determines whether the trend has changed. If LNCount > L N or if the 
derivative of the trend has changed as described in the first embodiment (equation 4) , 
then the trend has changed. 

• If the trend does not change at step 530, then increment n to n + 1 at step 550. 

• If the trend does change at step 530, then set n = 0 and LNCount = 0 at step 540. 

• Increment j at step 560 

DETAILED DESCRIPTION OF ALTERNATE EMBODIMENT - Flat Trend 

This embodiment allows a flat trend to be specified. A flat trend is one that has a slope 

equal to zero. This embodiment describes modifications to step 400 in Fig. 1, 210 in Fig. 8, and 

steps 420, 460 through 480, and 530 Fig. 4A. 

In this embodiment, the trend will change to a zero trend with the same value as the last 

point, fj_ x {x i j), if the derivative of the trend has changed sign as described in the first embodiment 

(equation 4). If the absolute value of the deviation from the trend exceeds L s as described in the first 
embodiment (equation 5), then the new trend will form as described in the first embodiment. 
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As a result of the adding a flat trend, there is a change to the parameters that are being 
used. The Initial Window Size {m x ) and Deviation Limit ( L s ), do not change, but the Deviation 
Limit is redefined to only apply to non-zero trends. Another deviation limit, the Flat Trend 
Deviation Limit ( L F ), is the limit that must be exceeded when the trend is a flat trend to define a 
new trend. Since L F is also a deviation measure, the same description as to what type of 
measure L s is (standard deviation, variance, range, etc.), also applies to L F . 

As a consequence, there is a slight change to how the trend determination parameters are 

selected in step 210 in Fig. 8. Flat Trend Deviation Limit parameters LFMIN, LFMAX, and 

LFINC are used instead of M2MIN, M2MAX, and M2INC. Otherwise, the process of selecting 

parameters is the same. Typical values for these new parameters are: 

LFMIN = 1.0 
LFMAX -20.0 
LFINC = 0.5 

The same variables are calculated and exported from step 300, except the trend determination 
parameters (m l9 L S9 L F ) are changed. 

In step 400, there are a few changes: 

• A new flat trend begins when the derivative of the trend has changed sign as described in 
the first embodiment (equation 4). If the trend is flat, then a new trend will be defined 
when the normalized deviation exceeds L F in step 530: 

• Initialize the trend determination parameters in step 420. The parameters are m l , the 
first window size; L s , the deviation limit; L F , the flat trend deviation limit; and m 2 , the 
second window size. 

• Step 460 will change if the trend is flat. If it is flat, then the value of the trend is simply 
the previous value of the trend. 



The derivative in step 470 will be zero if the trend is flat. 
The correlation coefficient in step 480 is zero. 
Steps 490, 500, 510, and 520 are the same as in the first embodiment. 
Test to determine whether the trend has changed at step 530. If the derivative of the 
trend has changed sign as described in the first embodiment (equation 4), then the trend 
changes to a flat trend and the value of the trend is fj_ x {x^ ), the predicted trend value 

from the previous iteration. If the trend is flat, then the trend will only be changed if 
[abs{d))>L F \ . 

W DETAILED DESCRIPTION OF ALTERNATE EMBODIMENT - Residuals from the Current 
L : Trend vs. Residuals from the Predictions 

ill This embodiment considers how the residuals are calculated in step 490. In the first 

r | embodiment, the residuals are calculated between the trend and its input values. In this 

embodiment, the residuals are calculated from the difference between the predicted trend and the 
1 5 data element or elements that are being evaluated to determine whether the elements are part of 

the trend or not. These residuals are accumulated with every iteration, so that the standard 

deviation of the residuals can be calculated in step 500. 

For the first iteration of the each trend, the residuals are calculated the same way as in the 

first embodiment. For subsequent iterations, the following changes are noted: 
20 • In step 490, accumulate the residuals dj_ x that were calculated between the predicted trend 

value and the actual value y ihl at the previous iteration (/-l) in step 510. Since d hl is 

already normalized by dividing by the trend, there is no reason to normalize in this step. 
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• The only change to step 510 is that the residual is saved for step 490 in the next iteration if 
the trend doesn't change. 

Otherwise, all other steps are the same. 

DETAILED DESCRIPTION OF ALTERNATE EMBODIMENT - Moving window from the 
previous trend 

This embodiment allows the number of m x elements from the previous trend to shrink 
with each iteration. This allows the effect of the previous trend to have a temporal effect on the 
current trend. Step 450 doesn't change for the first trend. However it changes in the following 
manner for subsequent trends. 

• Select m 2 values at step 450. 



where n is the length of the current trend. Therefore, for the first m x iterations, the number 
of elements that are used to fit the trend is constant and equal to m x . The data elements that 
are used to fit the trend represent a moving window that slides through the data with each 
additional data element. Once m x iterations have occurred, and the trend is continuing, the 
data elements that are used to fit the trend only come from the current trend. 




n + (m x - «), if n<m 
n, if n>m x 



DETAILED DESCRIPTION OF ALTERNATE EMBODIMENT - Alternate location for 
calculating the derivative of the trend 
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This embodiment allows for a different location for calculating the derivative of the trend 
in step 470 in Figs 4A and 9. In the first embodiment, the derivative of the trend is taken at they- 
lth index of the data elements, x UJ _ x =m 2 . In some cases, there may be an advantage to taking 



the derivative at another location. For example, the derivative, 



dx 

5 yth index, x itJ =m 2 +l. 



, may be taken at the 



Although only a few exemplary embodiments of this invention have been described in 
^ detail above, those skilled in the art will readily appreciate that many modifications are possible 
10 in the exemplary embodiments without materially departing from the novel teachings and 

advantages of this invention. Accordingly, all such modifications are intended to be included 
HI within the scope of this invention as defined in the following claims. In the claims, means-plus- 
^ function clauses are intended to cover the structures described herein as performing the recited 
function and not only structural equivalents, but also equivalent structures. Thus although a nail 
15 and a screw may not be structural equivalents in that a nail employs a cylindrical surface to 

secure wooden parts together, whereas a screw employs a helical surface, in the environment of 
fastening wood parts, a nail and a screw may be equivalent structures. 



